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Abstract 

We derive diffusion constants and martingales for senile random walks 
with the help of a time-change. We provide direct computations of the 
diffusion constants for the time-changed walks. Alternatively, the values of 
these constants can be derived from martingales associated with the time- 
changed walks. Using an inverse time-change, the diffusion constants for 
senile random walks are then obtained via these martingales. When the 
walks are diffusive, weak convergence to Brownian motion can be shown 
using a martingale functional limit theorem. 

1 Introduction and general framework 

In this paper we study random walks on 'Efi for dimensions d > 1 , which can be 
viewed as time-changes of random walks that were named senile reinforced and 
senile persistent random walks in [J. We will use this terminology also in this 
paper, although senile persistent random walks were originally introduced and 
studied under the name of directionally reinforced random walks in [6l [7] • The 
reinforcement of senile random walks is of a different kind than that of more 
traditional edge reinforced random walks, as introduced by Coppersmith and 
Diaconis [3]. For more details and discussion, we refer to the introductions and 
references in [H El 13 > s^nd to the recent survey paper [S] on reinforced random 
processes. 

Recurrence and transience properties of senile random walks were studied in 
the papers [11 [7|, and scaling limits are identified in [51 [6]. In this paper, rather 
than taking the senile random walks themselves as our starting point, we start 
by studying other random walks that are later interpreted as time-changes of 
senile random walks. The idea of looking at these time-changed walks has also 
been used in the mentioned references. However, this paper presents a different 
approach to identifying the diffusion constants and weak limits of the walks 
under study, using mainly martingale techniques. 
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Indeed, below we will provide new, direct calculations of the diffusion con- 
stants for the time-changed random walks, and we show that these random walks 
are close to martingales (for the persistent case, this has also been observed 
in [5]). Using martingale theory, we can then derive the diffusion constants for 
the senile random walks by an inverse time-change. This confirms that Theo- 
rem 2.5 in [3] holds under a slightly weaker moment condition, as conjectured by 
the authors. Finally, we will show that under appropriate conditions for which 
the walks are diffusive, weak convergence of senile random walks to Brownian 
motion follows from a martingale central limit theorem. 

We will now introduce a general framework for the time-changed walks 
we want to study below. Generally, the walks are described by a sequence 
W = {Wi,W2, ■ ■ ■) of random variables taking values in 'E'^. For each n G 
N := {1,2, . . .}, we will write Wn (the position at time n) as the sum of n 
random steps, where the mth step (m G N) has a direction Dm taking values 
in {ei, 62, . . . , e2rf}, the unit vectors of Z"*, and a length Lm G {0, 1,2,...}. 

Actually, for the single purpose of relating our walks to senile random walks 
later on, we will write each step length Lm as a function of a random variable Tm 
taking values in N = {1, 2, . . . }. These variables Tm are i.i.d. (hence, so are the 
step lengths) and define the random time-change linking our random walks to 
senile random walks. Below, we will use the notation T for a generic variable 
distributed as any one of the Tm- The distribution of the random times Tm is 
specified in terms of a function / : N — > [— l,oo) (the reinforcement function) 
by P(T > 1) = 1 and 

^(^^^)-n^^ forfc.2,3,... (1.1) 

This specific form of the distribution of the Tm is introduced only to make 
the link with senile random walk. For now, we do not put any restrictions on 
the function /, but later on, we will require that either ]E(r) is finite or both 
]E(T^) and ]E(T) are finite, depending on whether we consider the reinforced or 
the persistent case. 

Thus, following the description above, we can write 

n 

Wn := ^ Dm Lm for all n e N, (1.2) 

m— 1 

where the laws of the Dm and Lm are yet to be specified. In sections [2] and [3] we 
consider two specific instances of this general class of random walks, related to 
senile persistent and senile reinforced random walks, respectively. Our first aim 
will be to compute the diffusion constants for these walks, which for a general 
walk X = {Xi , X2 , . . . ) is defined by 

Cx lim iE(|X„p), (1.3) 

n — ^00 71 

provided the limit exists and is finite. To find the diffusion constants for the 
senile random walks, we will then make use of martingales associated with the 
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time-changed walks, and these martingales will also be used to prove weak 
convergence to Brownian motion when the senile walks are diffusive. 

2 The persistent case 

We start with the persistent case, for which the definition of the walk is some- 
what easier than in the reinforced case, but the analysis is harder. In this case, 
we take 

Lm = Tm for aU m e N, (2.1) 

and the directions of different steps obey the rule that the direction at each 
step has to be different from the direction at the previous step, but all re- 
maining choices of direction are equally likely. Formally, this means that the 
directions Dm satisfy 

P(Di=eO = ^ for each z = 1,2, ... ,2d, (2.2) 
and for all m S N, 

F(Dm+i = e, I Dm) = ^^^—^ l{Dm ^ e,) for each z = 1, 2, . . . , 2d, (2.3) 

where \{A) is the indicator of the event A. Equations (|2.ip - (|2.3p completely 
specify the law of the random walk defined by (|1.2p . For the remainder of this 
section we will write — (VFf , 14^2 j • ■ • ) foi' this walk, where the superscript p 
is used to single out the persistent case studied here. 

2.1 Direct calculation of the diffusion constant 

We will now provide a direct calculation of the diffusion constant for the random 
walk defined above. It will be clear from the computation that wc have to 
require that ]E(T^) < oo (which implies ]E(T) < oo). The diffusion constant is 
then given by the following proposition. 

Proposition 2.1. Assume ]E(T^) < oo. Then the diffusion constant of the 
random walk is given by 

CP := lim -EdW^^n = —. 

n^oo n a 

Proof. It is easy to see that 

n— 1 n — 

E(|WP|2) = nE(T2) + 2 ^ ^ E(i?™ • Dm+k LmLm+k), (2.4) 

k=l m=l 

where for all m, fc > 1, by independence of the step lengths, 

E(A„ • Dm+k LmLm+k) = ^{T)^ ^{Dm ' Dm+k). (2.5) 
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Now note that on the event Emk ■= {Dm+k-i ■ D„i+k = 0}, D„i ■ Dm+k takes 
on the values ±1 with equal probabilities, by (|2.3p . On the other hand, on the 
complementary event -E^^, we have that D^+k = —Dm+k-i- Therefore, using 
independence again, 



E(An • Dm+k) = 15(13™ • D„,+k HE.nk)) - ^D„, ■ Dm+k-1 l(£^™fe)) 



1 



(2.6) 



2d - 1 

Iterating this recursion relation, it follows that 

E {Dm ■ Dm+k) 



-1 



2d -I 

Plugging this expression into (|2.4p . we obtain 



(2.7) 



n-l 

E(|W^,^P) =nE(T2) +2E(T)2 ^ („ - fc) 

k=l 

'n 2d-l 



n 



E(t2) - E(T)^ 



2^2 



-1 
2d - 1 

-1 



(2.8) 



2(i- 1 



- 1 



By (|1.3p . this equation identifies the value of the diffusion constant if we divide 
by n and take the limit n oo. □ 



2.2 Martingales for the persistent random walk 

The purpose of this subsection is to show that the walk is within bounded 
distance from a martingale at each step. More precisely, we will see that adding 
a correction of constant length to each position gives us a martingale. In 
fact. Proposition 12 . 21 below identifies a second martingale by direct calculation, 
which can be used to provide an alternative derivation of the diffusion constant 
for the walk W^. 

To state our result, we introduce the filtration {J-'n '■ n e N}, where 

:=(T(A,Ti,i?2,T2,...,7^„,r„) forallnGN. (2.9) 
Now define a new random walk by 

MP := WP - D„ for all n € N. (2.10) 

As before, we assume thatE(T2) < oo. Then the following proposition identifies 
two martingales associated with the walk WP. 

Proposition 2.2. Let CP be the diffusion constant appearing in Provosition \2. 1[ 
Then {{MP,^,,) : n £ TM} and {{\MP\'^ -nCP,Tn) : n € TM} are martingales. 
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Proof. The essential ingredients for the proof are: (i) that the events Eni := 
{Dn ■ Dn+i = 0} and its complement E!f^i are independent of the events in JF„, 
(ii) that on the event E^^, Dn+i — —Dn, and (iii) that on the event Eni, Dn+i 
is distributed symmetrically (orthogonal to Dn). Observing that 



K+1 = MP + ^Dn+ Dn+l ( Ln + l " ^ ) , (2.11) 



it is then not difhcult to verify that 

E(MP+i I = E(M^+i l{Eni) I + E(MP+i ME^,,) \ Tn 
= Ml. 

Next we use (|2.1ip again, as well as \Dn\^ = 1, to compute 



2+ll — M"nl H r-i^„+i — Ln+x 



(2.12) 



+ ^A..A...(W-^). (2.13) 
In the same way as before, a straightforward calculation now leads to 

E(|M^+iP I Tn) = HEnl) I Tn)+n\K+i? HKl) \ ^n) 



dE(T2)-E(r)2 



(2.14) 

confirming the proposition. □ 



2.3 Connection with senile persistent random walk 

As alluded to in the introduction, the random walk studied above can 
be seen as a time-change of another random walk S'^, called senile persistent 
random walk, sampled at the random times 

n 

T„ := ^ Tfc for aU n G N. (2.15) 

fc=i 

The connection between the two walks is best established through the inverse 
of this time-change. That is, wc introduce the random map r^^ : N — *■ N by 
setting 

r,7^ := inf{TO G N : T„j > n} for each n G N. (2.16) 

Thus, for any point lo of the sample space, r~^(w) is the time m such that 
Tm-i{^) is less than n and Tm(uj) is at least n. Note that for every rt G IN, t^^ 
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is a stopping time with respect to the filtration {J^n ■ n S N}, since (setting 
TO 0) 

fc 

{r-i < fc} - IJ {t„,-i <n< T„,} = {n < t^} G .Ffc. (2.17) 

m— 1 

We also remark that t^^ < n a.s., since t„ is necessarily at least equal to n. 
The senile persistent random walk can now be defined by 

SP:=Wl_^+D^-i{n-T^-i) for aU n = 1, 2, . . . , (2.18) 

where r^-i = X]m=i -^m- It may not be obvious from this formal definition how 
the walk 3"^ behaves, so let us discuss this in more detail. First observe that 
S^^ — W^, so that we can indeed interpret as the senile random walk 
sampled at the times r„. Next we note that by (|2.18p . in between times r„_i 
and r„, the walk moves in a straight line from the position Wn-i to Wn, taking 
steps of unit length. Therefore, we see that the random walk is a walk which 
persists to move in a given direction for a random time distributed like T, then 
chooses a new direction uniformly at random, moves in that direction for a 
random time distributed again like T , and so on. 

It is now instructive to interpret the role of the function / appearing in the 
distribution p.ip of the random times r„ from the behaviour of the walk . 
Looking at equation (|l.ip . we see that the walk S'^, after having moved in the 
same direction for n steps, chooses to make the next step again in the same 
direction with a probability given by {\ + f{n))/{2d+ f{n)). Furthermore, aU 
other choices of direction for the next step are equally likely. This description 
of the walk corresponds to how the model was originally defined in [7J . 

Our next objective is to find the diffusion constant for the senile persistent 
random walk . It is given by the following result. 

Proposition 2.3. Suppose that lE(r^) < oo. Then the diffusion constant of 
the senile persistent random walk is given by 

1 , dE(T2)-E(r)2 CP 

dW =w-y 

Proof. The key observation is that at time n, is not far from at the 
stopping time r~^. To be precise, from the definitions (j2.10p and (|2.18p we see 
that for all n € N, 

SP = MP_, + D^-^ +n- r^-.) MP_, + X^, (2.19) 

where we have introduced X^ to denote the difference between and 
By the triangle inequality and Holder's inequality, we then have 

H\Sl?-\Ml^A^-\Xl\^) <2y^E(|M^^_,P)]E(|X^|2). (2.20) 
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Therefore, to prove Proposition 12. 31 it suffices to show that, on the one hand. 



im -E( M^'^iH ^ ^ ,\ , , 2.21 

and on the other hand, 

lim ^EfT^-i) = 0. (2.22) 

We win first show (|2.2ip by appeahng to Proposition 12.21 and the law of large 
numbers for the random times t„, before we prove (j2.22p . 

To ease the notation, we shall write for the diffusion constant of the 
walk appearing in Proposition 12.11 Now we observe that (by standard 
martingale theory, see e.g. 1, Theorem 6.7.3]) Proposition 12 . 21 and the fact that 
Ti^,T2^,.-. is an increasing sequence of stopping times imply that the process 

{|M^_i|2-r-iCP:neN} (2.23) 
is a martingale with respect to the filtration {jF^-i : n e N} defined by 

T^-i -.^ {Ae T : An {t-^ < k} e Tk for aU A: = 1, 2, . . . , n}. (2.24) 
Therefore, 

lim -E(|M''_i|2_^-icP) ^ lim 1 E(|Mf p - C'') = 0. (2.25) 

n — ^oo 71 ^ — *oo Tl 

But the strong law of large numbers dictates that ri^^r„ E(T), from which 
it follows that n-V-^ E(T)-i. Since r'^ < n a.s., we therefore have 

limiE(T-i) = ^ (2.26) 

n^oo n E(J ) 

by bounded convergence. Together with (|2.25p . this implies (|2.2ip . 

It remains to show ([2?22)) . To this end, observe that by ((2T9)) . \Xp\ is 
bounded by the sum of a constant and the term r^-i — n, which takes values 
between and T^-^- Because < n, it therefore suffices to show that Yn = 
maxk<n Tk / y/n converges to in probability and that the are uniformly 
integrable. But by Boole's and Markov's inequalities, for e > 0, 



P(maxTfc > eVn) < nF(T > e^/n) < — M{T^1{T^ > e^n)) ^„ 0, (2.27) 



because we are assuming that E(r2) < oo. This shows that y„ ^ in prob- 
ability. Uniform integrability of the Y^ follows from the fact that the Y^ are 
bounded by ^ X]fe=i "^k' which are uniformly integrable because they have mean 
E(T^), are positive, and converge almost surely to E(T^). This implies (|2.22p . 
and completes the proof of Proposition [231 CH 
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2.4 Weak convergence to Brownian motion 

We will now show weak convergence of to Brownian motion, by applying a 
martingale functional limit theorem to the martingale {M^_i : n S N} studied 
above. We follow Billingsley [U Section 18]. Let Z3[0,oo) be the metric space 
of right-continuous real functions on [0, oo) with left-hand limits which has the 
Skorohod topology, as in Section 16]. Generally, we will denote by W stan- 
dard Brownian motion on any functional space under consideration, and we 
write =J>„ to denote weak convergence with n. Setting 5*^ := for the senile 
persistent random walk, the following holds: 

Theorem 2.4. Assume ]E(r^) < oo. For every t > and n e N, define 



nCP Lntl' 



(2.28) 



where is the diffusion constant of appearing in Proposition \2.1\ Then 
W in the sense o/ £)[0, oo)'*. 

Proof. First we recall that is close to M^_i, as expressed by (j2.19p in the 
proof of Proposition 12.31 In fact, the proof of Proposition 12.31 shows that 
supQ<^<f \ /y/n converges to in probability for every fixed t > 0. There- 

fore, it suffices to prove weak convergence to Brownian motion for M^_i instead 
of SI. 

We recall that {M^_i : n e N} is a martingale with respect to the filtration 
T := {T^-i : n e N} defined by (H^. Let us now write M*_i, i = 1, 2, . . . , d, 
for the one-dimensional marginals of AP_^. For each n £ N, define 



dE(r) 



I CP 



l,2,...,c;; 



dE(r) 



I CP 



AP 



AP 



1,2,. 



fc = 2,3, . 



(2.29) 
(2.30) 



Then for each i, the ^^j, form a triangular array of martingale differences with 
respect to the filtration := {J-^-i : k S N}. 
By ((2lT|l we have for fc > 2 



(iE(T) 



I CP 



E(r) 



< 



2d V ^fe-i 

d^T) V-w -1 , -1 I ,nT) 



'.CP 



Kk 



dE(T) 
nCP 



1) 



E(T) 



(2.31) 



Setting To := 0, it is clear that this bound also holds for fc = 1. 
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Now fix e > and set S := ^e^/CPJcTEiT). Then from tfie bound on l^;^!, 
it follows that for n sufficiently large we have that 



k<nt 



- nCP 



J2 J2 =k-l) Tf l{Ti > 6VTi) 



k<nt Kk 



(2.32) 



Interchanging the order of summation and using that Y^l^Jl 1(t,_i = /c-1) < 1, 
we arrive at 

Y: HiCnk? HlCkl > e)) < E E [^1 MTi > SM] ■ (2.33) 

k<.nt l<7it 

Since the Ti are i.i.d. and E(T^) < cx), we conclude that for every t > 0, 

EE((afc)2l(iafcl>e))-nO. (2.34) 



k<nt 



Now put 



«,)2 :=E((e;.)^ I^F-O. 



(2.35) 



where we define T^-i to be the trivial cr-ficld {0,17}. By Proposition 12.21 and 
the symmetry of our random walks, for every i — 1, 2, . . . , d. 



{((m;_,)' - T-^CP/d,T^-^) : n G n} 
is a martingale. Therefore, for k > 2, 



nCP 
E(T) 



(2.36) 



(2.37) 



Next we observe that for alH, to G N (considering / > to and Z < to in turn), 
{r-i < /} n {r-_\ < to} = {n >k}n {t„ > fc - 1} e J^,„. (2.38) 

It follows by (|2.24|) that {t^T^ < ^} G ^tt^ ^'^^ ^ ^'^'^ hence, that the random 
variable tZ^ is in fact -i -measurable. Therefore, for fc > 2, 



(2.39) 



By the strong law of large numbers, it immediately follows that for every t > 0, 
E = E I .^.-ij t. (2.40) 



Now write (taking Mq := 0) 



dE(r) 



k<nt 

Then Theorem 18.2 in [5] states that because (pTiO)) and (PTMl) both hold, 
Y"^ W in the sense of D[0,oo). In other words, we have shown that the 
one-dimensional marginals 1""* converge weakly to Brownian motion. We now 
want to extend this to weak convergence of F" = (Y^-^, . . . , F"^). The proof 
of Theorem 18.2 in [2] shows that for each i the laws of the one-dimensional 
marginals K'" form a tight family. But since the product of compact sets in 
D[0, oo) is a compact set, this implies tightness of the family of laws of the V". 
It remains to show that all finite-dimensional distributions of converge to 
those of c?-dimensional Brownian motion. 

To show this, we need the additional result that for i ^ j and all n S N, 

E((M;+i - M^)(M;^+i - Mi) I .F„) = 0. (2.42) 

This can be seen by using (|2.1ip and noting that on the event {Z?„ • Dn+i 0}, 
Dn+i — —Dn whereas on the event {£)„ • Dn+i — 0}, D\^j^^D^^^ takes on each of 
the values ±1 with equal probabilities. It follows that for i ^ j and fixed n, the 
Cnk^iik ^^'^ martingale differences with respect to the filtration T. 

Now fix s, i > and let (ai, . . . , ad) and (5i, . . . , hd) be arbitrary vectors of 
real numbers. Define rjnk as '^^{ai + &i)Cnfc ^^^^ ^ — \-^^\ and as ^ihCnk ^'^^ 
[ns\ < k < [n{s + t)\. Then, by (|2.40p and because the Cnk^nk martingale 
differences when i j, 



E 

k<n(s+t) 



^{vlk I -^.-J ^„^(a.-H6,)^s + 5]6?t. (2.43) 



Therefore, by Theorem 18.1], E^{a^Yp' + 5,1;™ ) ^„ E^{a^W! + hW',+t), 
where the are the one-dimensional marginals of c?-dimensional Brownian 
motion. But since the ai and bi were arbitrary, by the Cramer- Wold device 
{Yr\ . . . , Yp", y,tt' • ■ - Yr+i) {W}, . . . , W^, W}^,, . . . , l^iVt)- It is easy to 
see that this argument can be generalized to show that all finite-dimensional 
distributions of Y" converge to those of d-dimensional Brownian motion. This 
completes the proof. □ 



3 The reinforced case 

We now turn our attention to the reinforced case, where we set 

L„, = 1(T,„ is odd) for aU m e N. (3.1) 

Thus, the lengths of the steps of the random walk are i.i.d. variables taking 
values in {0, 1}. However, the directions of different steps are not independent. 
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Namely, the step following a step of length may not have the same direction 
as the previous step, and the step foUowing a step of length 1 may not be in 
the opposite direction of the previous step. All other choices of direction are 
equally likely. Formally, the directions Dm satisfy 

P(L»i e,) = ^ for each i = 1, 2, . . . , 2d, (3.2) 
and for all m g N and each i = 1, 2, . . . , 2d, 

F{Dm+l = Ci I Dm,Lm) 

= ^ e„ L„ - 0) + l{Dm ^ -e„ L,n = 1). (3.3) 

Equations (|3.ip - (|3.3p completely specify the law of the random walk defined 
by ()1.2|) . For the remainder of this section, we will denote this walk by W^' = 
{W( , WJ, . . . ), where the superscript r is used to identify the reinforced case. 
From (|3.ip . it may not come as a surprise that the quantity 

p := F(T is odd) (3.4) 

plays an important role in the analysis of the reinforced case. In fact, if d = 1 
we see from (|3.3p that the walk has a trivial behaviour if p = 1, since then it 
keeps moving in the same direction. Let us therefore take the opportunity to 
exclude this special case from the analysis for the remainder of this section, so 
that we don't have to repeat the condition that p < 1 if d = 1 all the time. 
Note, however, that the case p = 1 is perfectly fine and nontrivial in higher 
dimensions. Also, when we consider the time-changed walk there will be no 
problem in allowing F(T = oo) > 0, where we may assume either that "T„ is 
odd" is false, or that "T„ is odd" is true if T„ oo, whichever one prefers. 



3.1 Direct calculation of the diffusion constant 

We will now compute the diffusion constant for the random walk defined 
above. In terms of the parameter p — P(r is odd), the diffusion constant is 
identified by the following proposition. 

Proposition 3.1. The diffusion constant of the random walk W is given by 

:= hm lE(|M/„n') =3^. 
n^oo n ^ ' d- p 

Proof. We start from the observation that 

71 — 1 n — k 

mw:\^) =np + 2j2 J2 E(A„ • A„+fci,nWfe), (3.5) 

k—l m—1 

where, since Dm ■ Dm+k Lm is independent of Lm+k, 

^{Dm • Dm+k LmLrn+k ) =p]E{Dm- Dm+kLm). (3.6) 
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Now note that on the event Emk ■= {Dm+k-i ■ D„i+k = 0}, ■ -Dm+fc takes 
on the values ±1 with equal probabilities by (|3.3|) . On the other hand, on 
the complementary event E'^^ we have that Dm+k — Dm+k-i {'^Lm+k-i ~ !)■ 
Therefore, again using independence. 



E(I?m • D,n+k L„i) — E(-D„i • _D„i+fc_i Lm{2Lm+k-l — 1) l(-Emfe)) 

2p- 1 



2d - 1 

Iterating this recursion and using 

]E(Z?„i • D„i+k Lm.Lm+k) ~ P 



we obtain 

fe-i 



2p-l 
2d - 1 

2 ^2p~l 



E(Z?„. • Dm+i L 

fe-1 



2d - 1 V 2d - 1 
Substituting this result into p.Sp yields 



r|2\ 



n p - 



2d - 1 ^ V2rf- 1 

2p-l 



fe=i 



dp p2(2d_i) 



d-p 2{d-pf 



2d -I 



k-l 



- 1 



(3.7) 



(3.8) 



(3.9) 



The value of the diffusion constant for the random walk follows. 



□ 



3.2 Martingales for the reinforced random walk 

The purpose of this subsection is to identify martingales associated with the 
random walk introduced above. Our main observation is that if we add a 
correction of constant length (but random direction) to the positions W^, then 
we obtain a martingale. To be precise, define 

:= + , Dn (2L„ - 1) for all n € N, (3.10) 

2{d~p) 

and let {Tn ■ G IN} be the filtration defined by 

Tn:^a{Di,Ti,D2,T2,...,Dn,T„) for aU n e N. (3.11) 
The following proposition identifies two martingales associated with W^. 

Proposition 3.2. LetC^ be the diffusion constant appearing in Provosition \S . 1\ 
Then {(M;, JC-„) : n e N} and {(jM^p -nC^T^) : n e N} are martingales. 

Proof. The key observation is that even though the direction itself depends 
on Dn and L„, the events Eni := {Dn ■ = 0} and its complement E^i are 

independent of the events in Tm and have the probabilities (2d — 2)/ {2d — 1) 
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and l/(2(i— 1), respectively. Moreover, on the event Eni, is distributed 

symmetrically (orthogonal to Dn), and on the event iS^i, we have = 
Dn C^Ln — 1). Now observe that for all n e N, 



2)„ (2i„ - 1) 



■ Z)„+i (2L„+i — 1) + Z)„+i L„+i. (3.12) 



2{d-p) 

A simple computation then yields 

e(m;+i I = e(m;+i i(£;„i) | + e(m;+i i(i?^i) | 

Likewise, for all n e N we can write 

"2 d 



(3.13) 



r |2 



IK+1 



a — p 



2(d-p)2+^l(^"+^ = l) 



(2L„ - 1) + £)„+! • m;; 



d — p 



(2Z/„+i — 1) + 2Z/„+i 



■ Dn ■ Dn+1 (2L„ - 1) 



2{d-p) 

A straightforward computation gives 



d — p 



(2L„_)_i — 1) + 2L„_|_i 



(3.14) 



E(|M;+i|2 I = E(|M;+i|2 l(£„i) I ^„) + E(|M;+i|2 l(£;^i) | ^„) 



d — p 



(3.15) 



This confirms that the two processes of the proposition are martingales with 
respect to the filtration : n G N}. □ 

3.3 Connection with senile reinforced random walk 

Like in the persistent case, the walk W'^' can be interpreted as a senile reinforced 
random walk sampled at the random times 



r„:=^Tfe for all n € N. 



fc=i 



As before, we concentrate on the inverse time-change defined by 
:= inf{m e N : > Ti} for each n e N. 



(3.16) 



(3.17) 



We recall that the random times t„ ^ are stopping times with respect to the 
filtration : n G N}, and that < n almost surely. 
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We may define the senile reinforced random walk on by 

S:;, := W^-i ~ D^-i 1{t^-i ~ n is odd) for all n e N, (3.18) 

where t^-i = J2m=i '^m- Observe that indeed S^^ = for all n € N, so that 
we may interpret W" as the senile random walk sampled at the times t„. 
Furthermore, by the definition (|3.18p . in between times t^^-^ and t~^, the walk 
S"^ jumps back and forth between the positions W^_i and W^. Thus, the senile 
reinforced random walk S'' is a walk that traverses an edge back and forth for 
a random time distributed like T, then selects a new edge uniformly at random 
and traverses that edge for a random time again distributed like T, and so on. 

As in the persistent case, this description gives us an interpretation of the re- 
inforcement function / defining the distribution of the random times T!„ in (jl.ip . 
Namely, the walk 5''' has the property that after it has been traversing the same 
edge back and forth for the last n steps, it will choose to traverse that edge 
again in the next step with probability (1 + f{n))/{2d + f{n)). Furthermore, 
all other choices for the next edge are equally likely. This corresponds to the 
original definition of the model in [4] . 

At this stage, we should note that the walk gets stuck on an edge in case 
Tn — oo for some n S N. For the remainder of this section, we will rule out this 
possibility by assuming P(r = oo) = 0. However, we note that the following 
proposition and proof hold perfectly well if ]E(T) — oo, when we take division 
by oo to yield 0. 

Proposition 3.3. For the senile reinforced random walk , the diffusion con- 
stant is given by 

limlE(|5-^^ ' 



„_oon ^' ' E(r) d-p E(T)' 

Proof. The proof proceeds in the same way as the proof of Proposition | 
and is in fact somewhat simpler. First we want to express 5"^ in terms of the 
martingale Af. By the definitions (|3.10p and (|3.18p we have for all n G N, 

=: iW-i +x: 



where we have introduced to denote the difference between at time n 
and M'' at time r~^. By the triangle inequality and Holder's inequality. 



M{\S:,\' - \My\' - \X:f) <2^E(|M;„,P)e(|X^P). (3.20) 
Since is bounded by a constant, it therefore suffices to show that 

hm iE(|M;_.p) = -^ (3.21) 

n^oo n ^1 E(J j 
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in order to prove Proposition 13. 31 

But Proposition l3.2l and the fact that the are stopping times with respect 
to the filtration {Tn ■ n & N} imply that {|M^_i|2 - r"^ C"' : n G N} is a 

martingale with respect to the filtration {^T^-i : n e N} defined by ([221. 
Therefore, 

lim -M(\M^-if -T-^C^) = lim - M(\Mlf -C) =0. (3.22) 

The strong law of large numbers dictates that n^^T,^^ -^^^ ]E(T)^^, from which 
we get by bounded convergence that n~^]E(T^^) E(T)^^. Together with the 
previous result this implies ()3.21|) . proving the proposition. □ 

3.4 Weak convergence to Brownian motion 

Weak convergence to Brownian motion for the senile reinforced random walk 
can be shown in the same way as for the persistent case, studied in Theorem l2.4l 
As before, we let D[0, oo) be the metric space of right-continuous real functions 
on [0, oo) with left-hand limits, and we write W for Brownian motion and 
for weak convergence with n. We assume ]E(T) < oo to work in the diffusive 
regime of Proposition 13.31 Then, setting Sq := 0, the following holds: 

Theorem 3.4. Assume 1E(T) < oo. For every t > and n G N, define 

where C is the diffusion constant of appearing in Proposition \3.1l Then 
Z"- ^„ W in the sense of D[Q,ooY. 

Proof. For the senile reinforced random walk, the difference between S^-^ and 
M^_i, as defined by (|3.2ip . is uniformly bounded by a constant. From this it 
follows that it is sufficient to prove weak convergence to Brownian motion for 
Af^i instead of S*!. 

As in the proof of Theorem I2.4[ let us write M*_i, i = 1, 2, . . . , d, for the 
one-dimensional marginals of M'^_i. For each n G N, define 




Then for each i, the form a triangular array of martingale differences with 
respect to the filtration T :— {^t--^ '■ k G N}. 

By p.l2[) it is clear that all random variables v^lCifcl uniformly bounded 
by a constant. We conclude that for every e > and t > 0, 

J2Hi^nkfH\ink\>^))^nO. (3.26) 

k<nt 
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Moreover, we can follow the steps (|2.35p - (|2.40p in the proof of Theorem 12.41 to 
see that for every i > 0, 

J2 ^{iCkf I ^r-^J t. (3.27) 

k<.nt 

If we now write, setting A/q := 0, 

k<.nt 

then Theorem 18.2 in [2] states that F"* =^>„ W in the sense of D[0,oo). In 
particular, for each i the laws of the one-dimensional marginals Y"^ form a tight 
family, which implies that the family of laws of = {Y"^, . . . , Y""^) is tight as 
well. It remains to show that all finite-dimensional distributions of Y" converge 
to those of ci-dimensional Brownian motion. 

As in the persistent case, the result will follow if we can show that for i j 
and all n S N, 

E((M;+i - M;)(M;^+i - Mi) I T„) = 0. (3.29) 

This can be shown by using (|3.12p and noting that on the event {Dn-Dn+i 0}, 
£>„+! = Dji {2Ln — 1) whereas on the event {£>„ • Dn+i = 0}, Dl^^iD^^ takes 
the values ±1 with equal probabilities. It follows that for i ^ j and fixed n, the 
Cnk^nk martingale differences with respect to the filtration J^. The proof 
can now be completed as in the persistent case. □ 
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